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The  information  and  communications  technology  (ICT)  held  is 
undergoing  a  period  of  tremendous  change.  The  exponential 
growth  rate  of  ICT  capability  in  recent  decades,  which  has  had 
an  undeniable  effect  on  every  aspect  of  our  society,  will  likely  have 
ramifications  for  military  operations  in  austere  environments.1  The  Air 
Force's  689th  Combat  Communications  Wing  commissioned  a  study  to 
forecast  the  future  of  mobile  ICT  in  such  environments.  Researchers  at 
the  Air  Force  Institute  of  Technology  chose  to  employ  the  Delphi  tech¬ 
nique  as  the  methodology  for  executing  this  task.  The  following  sce¬ 
nario,  based  on  the  results  of  that  study,  demonstrates  how  possible 
changes  in  ICT  might  affect  military  operations.  The  article  then  dis¬ 
cusses  relevant  issues  that  one  would  need  to  address  before  such  pos¬ 
sibilities  become  reality. 


The  Scenario: 

Sometime  during  the  Next  10  to  20  Years 
in  a  Country  Wracked  by  Natural  Disaster  and  Sectarian  Strife 

The  stealthy  remotely  piloted  aircraft  (RPA)  streaked  silently  over 
the  valley.  If  Senior  Master  Sergeant  Riley  had  blinked,  he  would  have 
missed  it,  but  he  was  expecting  the  aircraft.  The  sergeant  watched  in 
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anticipation  as  the  pointed,  narrow  cylinder  dropped  from  an  opening 
in  the  bottom  of  the  platform.  The  attack  drone  veered  and  accelerated 
towards  the  north,  vanishing  before  its  payload  hit  the  ground. 

With  perfect  precision,  the  cylinder  (not  standard  ordnance  but  a  ra¬ 
dio  frequency-satellite  communications  [RF-SATCOM]  network  link) 
hit  its  mark— the  top  of  the  tallest  mountain  overlooking  the  valley. 
This  new  device  supplied  cell-phone-like  connectivity  to  each  Soldier 
throughout  the  area  of  operations,  along  with  back-haul  connectivity  to 
the  rest  of  the  Department  of  Defense’s  worldwide  communications 
network.  Riley  had  used  the  backup  system  to  enter  the  request  only 
20  minutes  ago,  employing  a  series  of  linked  drones  to  send  a  message 
to  the  larger  staging  area  about  400  kilometers  due  north.  His  team 
was  responsible  for  securing  this  valley  and  setting  up  the  communica¬ 
tions  infrastructure  in  preparation  for  arrival  of  the  main  force,  which 
would  conduct  humanitarian-relief  efforts  for  the  local  population.  The 
latter  had  suffered  from  disastrous  flooding  and  landslides  brought 
about  by  a  stronger  than  normal  monsoon  season. 

A  light  began  blinking  on  the  small  device  strapped  to  Sergeant  Ri¬ 
ley's  forearm  as  he  walked  back  into  the  tent. 

"We're  back  up,”  said  Airman  First  Class  Biggs. 

"Good.  Where  are  they?” 

"About  15  kilometers  to  the  east.  Everyone's  vitals  are  within  nor¬ 
mal,  no  injuries.  Staff  Sergeant  Ramirez  reports  that  somebody  tried  to 
take  a  shot  but  turned  tail  when  they  returned  the  favor.  They’re  re¬ 
suming  their  patrol.  I'll  mark  it.”  Airman  Biggs  hit  a  few  buttons  on  his 
terminal.  A  moment  later,  a  chorus  of  beeps  arose  from  inside  the  tent 
as  everyone's  armband  announced  to  its  wearer  the  alert  and  subse¬ 
quent  map  update.  Fifteen  kilometers  way,  Ramirez  hit  a  few  key¬ 
strokes  on  his  armband.  A  mortar  tube  automatically  pivoted  towards 
the  marked  sector  should  its  services  be  needed. 

Riley  sighed  in  relief.  The  scout  patrol  had  recently  reported  that  it 
had  taken  some  harassing  fire,  and  then  as  if  on  cue,  the  primary  net- 
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work  went  down.  Several  warlords  in  this  part  of  the  country  weren't 
thrilled  about  their  presence,  so  someone  had  remotely  hacked  into 
the  network  and  introduced  a  virus  that  attacked  friendly  tactical  sys¬ 
tems.  The  intelligent  security  systems  had  detected  the  intrusion  and 
deployed  countermeasures  but  not  before  the  primary  intratheater 
link  went  down.  Though  internationally  banned,  those  types  of  tech¬ 
nologies  somehow  still  showed  up  in  environments  such  as  these.  Ri¬ 
ley  grinned,  wondering  if  his  adversary  had  his  device  in  his  pocket 
when  it  suddenly  overheated  and  caught  hre. 

"Sergeant  Riley,  Ramirez  says  his  helmet  cam  caught  a  glimpse  of 
one  of  the  attackers,  but  I  doubt  that  these  guys  are  in  the  system  at 
Langley.  I  saw  this  improved  'hostile  or  friendly'  app  on  the  net  ear¬ 
lier.  What  we've  got  is  tied  only  to  the  known  hostiles  in  the  system, 
but  this  new  one  can  match  the  pic  from  Ramirez  with  anybody  in 
view.  If  somebody  crosses  paths  with  him  again,  like  in  the  village 
market,  it'll  'paint'  him,”  offered  Biggs. 

"Nice.  If  it's  got  more  than  three  out  of  four  stars,  go  ahead  and  pull 
it  down,”  replied  Riley.  The  online  toolbox  was  a  lifesaver,  literally. 
Troops  in  the  held  who  needed  a  new  capability  for  any  particular  situ¬ 
ation— or  who  already  had  one  but  needed  an  upgrade— could  just 
download  it  from  the  secure  repository  practically  anywhere  on  the 
planet.  They  could  even  rate  it  as  a  good  app  or  a  dud.  Riley  looked 
back  at  Airman  Biggs  and  tried  to  remember  being  so  young.  Biggs  re¬ 
ally  knew  his  way  around  this  technology  stuff,  as  was  usually  the  case 
with  the  younger  troops.  Obviously  a  generational  thing,  they  all  grew 
up  just  expecting  it  to  be  there  and  ready  to  use.  He  probably  wouldn’t 
even  recognize  the  Air  Force  that  Riley  knew  when  he  was  that  age: 
hauling  around  all  that  comm  equipment  that  usually  did  only  one 
thing  and  oftentimes  not  all  that  well;  bulky,  fuel-hungry  generators 
that  advertised  your  exact  location  to  every  jerk  with  an  AK-47  within 
100  kilometers;  the  mountains  of  batteries  that  you  had  to  bring  in  and 
carry  around.  .  .  . 
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A  voice  emanating  from  his  armband  brought  him  back  to  the  pres¬ 
ent.  “Sergeant  Riley,  what's  your  status?"  It  was  Major  Hanson.  Located 
at  the  staging  area,  he  was  conducting  final  preparations  for  deploy¬ 
ment  of  the  main  force. 

“Sir,  we've  had  a  few  hiccups,  but  nothing  serious.  We're  on  sched¬ 
ule,  and  the  equipment  is  almost  ready,”  Riley  responded. 

“Brilliant.  We're  bringing  a  few  extra  teams  for  security.  Will  that  be 
an  issue?” 

“Shouldn't  be,  but  it  might  be  a  good  idea  to  throw  on  a  couple  of  ex¬ 
tra  gateways  to  increase  our  bandwidth,  just  in  case.”  You  can  never 
have  too  much  bandwidth,  even  out  here.  “A  few  extra  teams”  had  a 
wide  interpretation;  too  many  heads  might  start  dragging  down  the  lo¬ 
cal  network.  Having  some  cushion  ready  to  go  would  be  nice.  Maybe 
he  should  ask  for  another  solar  power  supply  as  well— after  all,  they 
don't  take  up  much  room. 

While  Riley  updated  the  major,  the  network  autonomously  uploaded 
a  profile  of  the  attack  to  the  main  system  at  Langley.  There,  it  would 
analyze  the  data  and  push  out  a  patch  with  updated  security  algo¬ 
rithms.  The  entire  theater  would  have  immunity  within  the  hour. 


Behind  the  Scenario 

This  story  sounds  like  something  out  of  science  fiction.  However,  ac¬ 
cording  to  the  Delphi  panel  that  offered  input  for  this  research,  the 
technologies  it  describes  maybe  in  place  within  the  next  10  to  20 
years— in  some  cases,  perhaps  even  sooner.  A  research  methodology, 
the  Delphi  technique  forecasts  future  possibilities  based  on  expert 
knowledge  of  areas  relevant  to  the  study.2  This  method  “has  become  a 
fundamental  tool  for  those  in  the  area  of  technological  forecasting.”3  In 
fact,  many  researchers  advocate  it  for  research  involving  subjects  for 
which  a  previous  datum  is  unavailable  or  nonexistent.4  R.  C.  Oliver 
and  his  colleagues  also  confirm  that  “Delphi  is  best  suited  for  evaluat- 
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ing  the  alternatives  of  some  definable  although  not  necessarily  narrow 
issue  ...  in  which  the  experience  of  experts  is  of  particular  value.”5  Fi¬ 
nally,  Somnath  Mishra,  S.  G.  Deshmukh,  and  Prem  Yrat's  analysis  to 
match  forecasting  techniques  with  specific  technologies  found  the  Del¬ 
phi  method  a  particularly  good  fit  for  studies  related  to  information 
technology.6 

The  National  Defense  University  has  presented  four  major  catego¬ 
ries  of  the  ICT  industry:  hardware,  software,  information  services,  and 
communications.  It  further  divides  these  categories  into  sectors  such 
as  cable,  telecommunications,  manufacturing,  cellular  phones,  soft¬ 
ware,  computer  and  networking  hardware,  the  Internet,  data  storage, 
and  associated  services  and  applications.7  In  the  context  of  its  report, 
the  university  developed  these  categories  to  capture  the  state  of  the 
ICT  industry  as  it  presently  exists.  However,  research  for  this  article 
attempted  to  address  the  predicted  capabilities  of  ICT  in  future  states. 
Certain  knowledge  areas  that  would  prove  useful  in  generating  a  fore¬ 
cast-such  as  trends,  revolutionary  concepts,  and  both  basic  and  ap¬ 
plied  inquiry— did  not  seem  well  represented  in  the  existing  categories 
as  defined.  Therefore,  researchers  at  the  Air  Force  Institute  of  Technol¬ 
ogy  first  examined  major  categories  of  the  ICT  field  and  derived  five 
general  knowledge  areas  more  practical  for  forecasting  future  capabili¬ 
ties:  concept  design  and  demand,  research  and  intellectual  aspects, 
technology  development,  application,  and,  ultimately,  employment. 

No  firm  agreement  exists  on  the  number  of  panelists  necessary  for 
an  effective  Delphi.8  On  the  one  hand,  Albert  P.  C.  Chan  and  his  col¬ 
leagues  find  10  members  an  adequate  number  of  panelists  to  repre¬ 
sent  a  sufficiently  wide  distribution  of  opinion.9  On  the  other  hand, 
some  studies  show  no  consistent  relationship  between  panel  size  and 
effectiveness.10  Regarding  the  minimum  number  of  panelists,  Jacques 
Etienne  Des  Marchais  indicates  a  minimum  of  six.11  Further,  David 
Boje  and  J.  Keith  Murnighan  found  no  effect  for  group  sizes  of  three, 
seven,  and  11. 12 
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Using  the  Internet,  academic  journals,  and  social  networking,  the  re¬ 
search  team  developed  a  list  of  100  potential  panelists  across  the  five 
knowledge  areas  from  organizations  including  academe,  non-Air  Force 
governmental  organizations,  and  the  private  sector.  These  individuals 
represented  a  wide  spectrum  of  involvement  within  the  ICT  industry, 
including  concept  development,  research  and  development,  technol¬ 
ogy  development,  application,  and  the  employment  of  technology.  Af¬ 
ter  prioritizing  the  list  with  the  sponsoring  agency,  the  research  team 
contacted  the  25  most  desirable  candidates,  securing  the  participation 
of  eight  experts. 

Critics  of  Delphi  cite  the  difficulty  of  defining  those  criteria  that 
make  someone  an  expert.  For  the  purposes  of  this  article,  we  use  Y.  W. 
Mitchell's  definition  of  an  expert  as  one  who  has  had  a  significant 
amount  of  involvement  within  the  industry,  both  past  and  present.13 
Many  studies  recommend  a  minimum  of  five  years  of  specific  experi¬ 
ence  in  the  particular  industry,  which  we  used  as  the  defining  factor  of 
expertise  within  the  ICT  industry.14  All  participants  have  between  20 
and  40  years  of  experience  in  their  held. 

Participants  on  the  Delphi  panel  included  a  board  member  of  the  As¬ 
sociation  of  Professional  Futurists  who  has  coauthored  books  on  the 
future  of  technology;  a  program  manager  in  the  area  of  defense  elec¬ 
tronics,  communications,  and  signal  processing;  an  associate  professor 
of  systems  engineering  specializing  in  information  operations,  mission 
assurance,  computer  and  network  security,  quantum  cryptography 
and  information,  and  mission-impact  assessment;  a  director  of  busi¬ 
ness  development  and  sales  for  a  major  satellite  communications 
group,  specializing  in  deployable  communications;  a  practice  leader 
specializing  in  telecommunications,  innovation  science,  and  opera¬ 
tions  management  who  has  worked  at  major  research  facilities;  a  chief 
software  architect  and  development  lead  at  a  technology  consulting 
group;  a  disaster-communications  engineer  at  a  major  networking  cor¬ 
poration;  and  a  federal  government  professional  in  emergency  re¬ 
sponse  to  information-technology  disasters. 
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Although  the  scenario  is  based  on  the  forecast  developed  by  the  Del¬ 
phi  panel,  the  latter  did  not  create  it.  Rather,  the  authors  developed  the 
scenario  to  illustrate  how  the  ideas  presented  in  the  forecast  could  af¬ 
fect  the  use  of  deployed  communications  in  the  near  future.  The  fol¬ 
lowing  discussion  explores  issues  included  in  the  scenario  that  high¬ 
light  changes  we  may  expect  to  see  in  such  communications  during 
the  coming  years. 

Bandwidth 

The  RF-SATCOM  network  link  dropped  from  the  RPA  signifies  one  of 
the  trends  among  the  panelists'  forecasts.  As  ICT  evolves,  despite  evo¬ 
lutions  in  protocols  and  data-compression  techniques,  bandwidth  re¬ 
quirements  will  continue  to  grow— possibly  at  an  exponential  rate.  The 
panelists  suggested  that  the  increase  in  bandwidth  needs  stems  from 
expanded  data  exchange  among  robots,  sensors,  RPAs,  and  personal 
ICT  devices  such  as  smartphones  and  tablets.  Therefore,  as  we  move 
into  future  engagements,  the  availability  of  usable  bandwidth  provid¬ 
ing  gateways  to  access  the  Global  Information  Grid  (GIG)  will  escalate 
dramatically.  The  ability  simply  to  “deploy”  a  unit  similar  to  the  RF- 
SATCOM  network  link  in  an  unforgiving  environment  as  a  means  of 
facilitating  near-instant  accessibility  to  data  exchange  will  likely  in¬ 
crease  virtually  all  aspects  of  the  campaign  it  supports,  whether  a  hu¬ 
manitarian-relief  effort  in  Haiti  or  terrorist  suppression  in  Africa. 

Satellites  versus  Alternatives 

The  experts  had  divergent  views  on  how  deployed  communications 
systems  would  link  back  to  the  GIG.  The  scenario  uses  both  projected 
technologies.  First,  the  self-configuring  RF-SATCOM  network  link  acts 
as  a  gateway  to  the  GIG,  providing  wireless  RF  connectivity  to  autho¬ 
rized  devices  within  the  area  of  operations.  As  described  by  the  panel¬ 
ists,  some  austere  locations  create  great  difficulties  for  a  direct  satellite 
link.  For  instance,  locations  under  high  foliage,  such  as  a  jungle  envi¬ 
ronment,  as  well  as  those  inside  hardened  shelters  and  under  water 


November-December  201 3 


Air  &  Space  Power  Journal  |  88 


V  Views 


render  satellites  less  effective.  Other  panelists  envisioned  highly  mo¬ 
bile  data  links  in  the  form  of  RPA  relay  systems.  In  the  scenario,  Ser¬ 
geant  Riley  uses  this  as  a  temporary  communications  medium  to  re¬ 
quest  the  more  robust  satellite-link  back-haul  system. 

Personal  Information  and  Communications  Technology 

As  devices  and  applications  converge  into  smaller,  faster,  and  cheaper 
individual  computing  devices,  their  interfaces  will  evolve.  The  interac¬ 
tion  will  become  more  fluid  as  the  interfacing  experience  begins  to 
transform  to  sensory  inputs,  biological  queues,  and  eventually  human- 
enhancement  implants.  Sergeant  Ramirez  communicates  with  Airman 
Biggs  with  a  device  similar  to  current  smartphones,  but  it  also  monitors 
his  vitals  via  a  few  nonintrusive  biological  sensors  capable  of  immedi¬ 
ately  alerting  both  the  wearer  and  nearby  allied  forces  if  any  readings 
fall  outside  a  predetermined  threshold.  Additionally,  thanks  to  the  fact 
that  the  RF-SATCOM  network  link  offers  local  device-to-device  commu¬ 
nications,  the  dissemination  of  mission-critical  information  and  sup¬ 
porting  data  now  takes  place  in  real  time— as  occurred  when  Airman 
Biggs  sent  an  alert  and  map  update  throughout  the  unit.  This  update 
warns  friendly  forces  about  hostiles  nearby  and  allows  Sergeant 
Ramirez  to  coordinate  retaliatory  hre  from  isolated  locations,  enhanc¬ 
ing  both  his  unit's  safety  and  combat  effectiveness.  The  sergeant  cap¬ 
tures  and  processes  photos,  using  them  to  query  and  update  the  remote 
database.  This  ability  signifies  two  possibilities.  First,  it  underscores  the 
necessity  of  global  connectivity  to  send  data  to  troops  in  rugged  loca¬ 
tions.  Second,  it  illustrates  possible  advantages  of  an  application  reposi¬ 
tory  providing  real-time  access  and  updates  to  mission-support  soft¬ 
ware.  According  to  the  panelists,  multiple  commercial  entities  have 
already  successfully  implemented  similar  corporate  repositories. 

Power 

The  panelists  also  considered  the  powering  of  ICT  devices,  identifying 
power  generation,  storage,  and  distribution  as  areas  of  concern.  In  the 
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scenario,  Sergeant  Riley  reminisces  about  deployed  forces  relying  ex¬ 
clusively  on  petroleum-based  power  generation  and  replaceable  batter¬ 
ies.  The  panelists  forecast  that  power  generation  will  slowly  change 
from  current  methods  to  technologies  such  as  fuel  cells  and  locally  de¬ 
veloped  power  that  uses  renewable  methods  such  as  wind,  water,  and 
sunlight.  Such  renewability  is  beneficial  from  more  than  simply  an  en¬ 
vironmental  standpoint.  Currently,  the  power  needed  to  run  a  forward 
operating  base  demands  many  fuel  generators,  which  leave  a  large 
footprint.  Additionally,  the  fact  that  generators  require  fuel  and  main¬ 
tenance  adds  to  the  logistics  burden.  Local  renewable  energy  sources 
would  drastically  reduce  the  number  of  support  personnel  and  de¬ 
mands  for  supply.  Power  storage  and  distribution  converged  in  this 
scenario  when  the  sergeant  thought  to  request  another  solar  power 
supply.  Panelists  suggested  that  the  incremental  battery  improve¬ 
ments,  combined  with  personal  ICT  evolution  that  lowers  power  con¬ 
sumption,  will  extend  ICT  battery  life  substantially.  Members  of  the 
panel  suggested  wireless  power  distribution  but  acknowledged  that  it 
might  not  be  feasible  in  the  near-to-moderate  future  due  to  radio  inter¬ 
ference  and  health-related  risks. 

Security 

The  panelists  forecast  that  as  our  networks  become  more  modular  and 
based  on  Internet  protocol,  devices  would  become  more  autonomous- 
witness  the  part  of  the  scenario  when  the  network  pushes  the  attack 
profile  to  Langley  for  automated  analysis  and  creation  of  a  security 
patch.  However,  some  panelists  cautioned  that  because  these  modular 
network  devices  may  be  engineered,  manufactured,  and  programmed 
for  autonomy  outside  the  Department  of  Defense,  one  must  consider 
possible  security  risks  akin  to  "backdoor  computing”  (bypassing  nor¬ 
mal  authentication  and  thus  securing  illegal  remote  access  to  a  com¬ 
puter).  The  panelists  concurred  that  data  security  will  be  a  concern  in 
the  distant  future.  As  ICT  evolves,  so  will  malicious  attackers;  further¬ 
more,  as  personal  ICT  proliferates,  becoming  less  expensive  and  more 
ubiquitous,  the  pool  of  potential  attackers  will  grow  in  step  with  it. 
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The  Way  Ahead 

It  seems  naive  to  assume  that  humankind  will  continue  to  conduct 
traditional  warfare  even  as  ICT  developments  prompt  new  operational 
capabilities  and  demands.  Instead,  we  should  attempt  to  envision  how 
the  latter  will  improve  operations.  Commentary  from  the  eight  experi¬ 
enced  ICT  industry  experts  yielded  the  common  trends  identified  and 
discussed  above.  Bandwidth  requirements  will  increase  rapidly,  and 
back-haul  systems  linking  forward  operating  locations  to  the  GIG  will 
develop.  Satellite  capabilities  will  multiply,  just  as  alternatives  and 
RPA-relayed  mediums  will  emerge.  Personal  ICT  devices  will  progress 
and  proliferate.  The  convergence  of  applications  and  data  services  on 
these  devices  will  decrease  the  number  of  tasks  that  they  cannot  per¬ 
form.  As  power  techniques  develop,  a  "charged”  device  will  operate 
substantially  longer  before  depleting  its  power  source.  In  terms  of  se¬ 
curity,  human  nature  creates  a  continuous,  reciprocal  battle  of  mea¬ 
sure/  countermeasure/ countercountermeasure,  and  so  forth.  An  inter¬ 
esting  perspective  to  consider  is  that  the  forecasts  we  used  to  produce 
this  scenario  did  not  specify  particular  developments  or  actual  capa¬ 
bilities;  rather,  they  identified  distinct  trends  and  likely  paths  of  ICT 
evolution.  Through  this  perspective  we  can  apply  these  trends  not  as  a 
specified  plan  of  action  but  as  a  planning  tool  designed  to  gain  and 
maintain  adversarial  advantages.  As  President  Dwight  D.  Eisenhower 
declared,  "Plans  are  nothing;  planning  is  everything.”  © 


Notes 

1.  Richard  E.  Albright,  "What  Can  Past  Technology  Forecasts  Tell  Us  About  the  Future?,” 
Technological  Forecasting  and  Social  Change  69,  no.  5  (June  2002):  455;  Heebyung  Koh  and 
Christopher  L.  Magee,  "A  Functional  Approach  for  Studying  Technological  Progress:  Applica¬ 
tion  to  Information  Technology,"  Technological  Forecasting  and  Social  Change  73,  no.  9  (No¬ 
vember  2006):  1071;  Christopher  L.  Magee  and  Tessaleno  C.  Devezas,  "How  Many  Singulari¬ 
ties  Are  Near  and  How  Will  They  Disrupt  Human  History?,"  Technological  Forecasting  and 
Social  Change  78,  no.  8  (October  2011):  1368;  Luiz  C.  M.  Miranda  and  Carlos  A.  S.  Lima, 
"Ttends  and  Cycles  of  the  Internet  Evolution  and  Worldwide  Impacts,"  Technological  Forecast- 


November-December  201 3 


Air  &  Space  Power  Journal  |  91 


V  Views 


ing  and  Social  Change  79,  no.  4  (May  2012):  744-65;  and  Bela  Nagy  et  al.,  "Superexponential 
Long-Term  Tiends  in  Information  Technology,"  Technological  Forecasting  and  Social  Change 
78,  no.  8  (October  2011):  1356-64. 

2.  Norman  Dalkey  and  Olaf  Helmer,  An  Experimental  Application  of  the  Delphi  Method  to 
the  Use  of  Experts,  Memorandum  RM-727/1 -Abridged  (Santa  Monica,  CA:  RAND  Corporation, 
July  1962),  http://www.rand.org/content/dam/rand/pubs/research_memoranda/2009 
/RM727.1.pdf;  and  Norman  C.  Dalkey,  The  Delphi  Method:  An  Experimental  Study  of  Group 
Opinion,  RM-5888-PR  (Santa  Monica,  CA:  RAND  Corporation,  June  1969),  http://www.rand 
.org/  content/dam/rand/pubs/research_memoranda/2005/RM5888.pdf. 

3.  Harold  A.  Linstone  and  Murray  Ttiroff,  "Introduction,”  in  The  Delphi  Method:  Tech¬ 
niques  and  Applications,  ed.  Harold  A.  Linstone  and  Murray  Throff  (Reading,  MA:  Addison- 
Wesley  Publishing,  Advanced  Book  Program,  1975),  11,  http://is.njit.edu/pubs/delphibook 
/  delphibook.pdf. 

4.  Gene  Rowe  and  George  Wright,  "The  Delphi  Technique  as  a  Forecasting  Tool:  Issues 
and  Analysis, "  International  Journal  of  Forecasting  15,  no.  4  (October  1999):  353-75,  http:// 
www.forecastingprinciples.com/files/delphi%20technique%20Rowe%20Wright.pdf. 

5.  R.  C.  Oliver  et  al.,  Survey  of  Long-Term  Technology  Forecasting  Methodologies  (Alexan¬ 
dria,  VA:  Institute  for  Defense  Analyses,  November  2002),  ES-2,  http://www.dtic.mil/dtic 
/tr/fulltext/u2/ a410179.pdf. 

6.  Somnath  Mishra,  S.  G.  Deshmukh,  and  Prem  Vrat,  "Matching  of  Technological  Fore¬ 
casting  Technique  to  a  Technology,"  Technological  Forecasting  and  Social  Change  69,  no.  1 
(January  2002):  20. 

7.  Industrial  College  of  the  Armed  Forces,  Final  Report:  Information  and  Communications 
Technology  Industry  (Washington,  DC:  Industrial  College  of  the  Armed  Forces,  National  De¬ 
fense  University,  Spring  2007),  4,  http://www.nationaldefensemagazine.org/archive/2008 
/  August/Documents/ICAFAug.pdf. 

8.  Patricia  L.  Williams  and  Christine  Webb,  "The  Delphi  Technique:  A  Methodological 
Discussion,”  Journal  of  Advanced  Nursing  19,  no.  1  (January  1994):  180-86. 

9.  Albert  P.  C.  Chan  et  al.,  "Application  of  Delphi  Method  in  Selection  of  Procurement 
Systems  for  Construction  Projects,"  Construction  Management  and  Economics  19,  no.  7  (Janu¬ 
ary  2001):  699-718. 

10.  Fergus  Bolger  and  George  Wright,  "Assessing  the  Quality  of  Expert  Judgment:  Issues 
and  Analysis,"  Decision  Support  Systems  11,  no.  1  (January  1994):  1-24;  and  Klaus  Brockhoff, 
"The  Performance  of  Forecasting  Groups  in  Computer  Dialogue  and  Face-to-Face  Discus¬ 
sion,"  in  Linstone  and  TUroff,  Delphi  Method,  285-311. 

11.  Jacques  Etienne  Des  Marchais,  “A  Delphi  Technique  to  Identify  and  Evaluate  Criteria 
for  Construction  of  PBL  Problems,"  Medical  Education  33,  no.  7  (July  1999):  505. 

12.  David  M.  Boje  and  J.  Keith  Murnighan,  "Group  Confidence  Pressures  in  Iterative  De¬ 
cisions,"  Management  Science  28,  no.  10  (October  1982):  1195. 

13.  V.  W.  Mitchell,  "The  Delphi  Technique:  An  Exposition  and  Application,”  Technology 
Analysis  and  Strategic  Management  3,  no.  4  (1991):  340. 

14.  Ibid.,  356;  and  Rowe  and  Wright,  "Delphi  Technique  as  a  Forecasting  Jbol,"  371. 


November-December  201 3 


Air  &  Space  Power  Journal  |  92 


★  ★ 


V  Views 


Capt  Andrew  Soine,  USAF 

Captain  Soine  (BS,  Louisiana  Tech  University;  MS,  Air  Force  Institute  of  Tech¬ 
nology)  is  a  program  manager  with  the  Manufacturing  and  Industrial  Tech¬ 
nologies  Division,  Materials  and  Manufacturing  Directorate,  Air  Force  Re¬ 
search  Laboratory,  Wright-Patterson  AFB,  Ohio.  He  is  responsible  for  planning, 
managing,  and  executing  programs  that  provide  advanced  manufacturing 
processes,  techniques,  and  technologies  for  timely,  high-quality,  and  economi¬ 
cal  production  and  sustainment  to  strengthen  the  defense  industrial  base 
under  the  Title  III  program  of  the  Office  of  the  Secretary  of  Defense's  Defense 
Production  Act.  He  also  addresses  Air  Force  systems  through  the  service's 
ManTech  program.  Captain  Soine  previously  served  in  the  Space  Development 
and  Test  Directorate,  Kirtland  AFB,  New  Mexico;  the  580th  Aircraft  Sustain¬ 
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